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In this paper, the dynamics of heuristic algorithms for constructing small vertex covers (or inde- 
pendent sets) of finite-connectivity random graphs is analysed. In every algorithmic step, a vertex 
is chosen with respect to its vertex degree. This vertex, and some environment of it, is covered and 
removed from the graph. This graph reduction process can be described as a Markovian dynamics 
in the space of random graphs of arbitrary degree distribution. We discuss some solvable cases, in- 
cluding algorithms already analysed using different techniques, and develop approximation schemes 
for more complicated cases. The approximations are corroborated by numerical simulations. 
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I. INTRODUCTION 



Many questions of practical or scientific interest are based on combinatorial optimization problems whose numerical 
solution requires time resources growing exponentially with the system size, or more precisely, with the number of 
binary variables needed to encode the problem. These include examples like planning and scheduling problems 
in various real-world applications, optimization of chip design, cryptografic systems in computer science, or glassy 
systems and random structures in physics. All these problems are characterized by a non-trivial cost function, or 
energy, which has to be minimized over a large set of discrete degrees of freedom. 

The hardest of these optimization problems are collected in a class called NP-hard Q. Hardness refers in this 
context to the exponential growth of the computational resolution time which is observed for all known numerical 
algorithms. Despite an extremely large number of known NP-hard problems, and numerous approaches to solve 
them, no algorithms could be constructed by now which are able to solve such a problem in a time growing only 
polynomially with the system size. This point supports the widespread conjecture, that no such effective algorithms 
are constructible. 

The numerical search for globally optimal solutions is thus restricted to relatively small systems. Once one has 
to solve larger systems, good polynomial-time algorithms are needed which construct low-cost configurations. These 
are not guaranteed to be optimal, but in many cases they can serve as reasonable approximations p|. Many of these 
algorithms are based on heuristic considerations, e.g. on expected correlations between local structures of the specific 
problem instance and its optimal solutions. Exploiting these correlations can largely improve the performance of a 
heuristic procedure. 

Here we are using the example of vertex covers (VC) on random graphs. It belongs to the basic NP-hard problems 
jl| and can be considered as a prototype optimization problem over a random structure. In every step of the presented 
heuristic algorithms, a vertex and possibly some environment is chosen randomly and covered locally optimal. The 
local structure of the graph, in particular its vertex-degree distribution (distribution of co-ordination numbers), can 
be exploited: Vertices of high degree are more likely to be covered, those of small degree are more likely to remain 
uncovered. We are using random graphs in order to get some information about the typical-case behaviour of the 
algorithm. This is to be contrasted with the worst-case picture used in the traditional theory of computational 
complexity Q). 

The study of heuristic algorithms is also interesting from a more theoretical point of view. Many randomized 
optimization or decision problems show characteristic phase transition, when the parameters of the randomness are 
tuned, see e.g. the special issues || || for an overview. The analysis of algorithms is frequently used in theoretical 
computer science to construct bounds for these phase transitions, for some examples see e.g. [|[ [| 0, ||, f§ and 
references therein. A different approach to these transitions is given by applying techniques from equilibrium statistical 
mechanics, as was done successfully for some of the fundamental combinatorial problems like 3-satisfiability Jl0[ [IT) , 
number partitioning |Q , or also vertex cover jl3| [l4| . 

This paper is organized as follows: In section II, we introduce the definition of vertex covers and independent sets, 
present the algorithms and review some important facts on random graphs. The general dynamical equations for the 
graph evolution process are developed in section III , and they are solved for some cases in section [V . Section T 
dedicated to approximations of the dynamical behaviour of cases which could not be solved exactly. In section] 
we present how the leaf-removal algorithm of Bauer and Golinelli |l5|, |l6| fits into the presented scheme. It is also 
generalized to cases where the original algorithm fails to construct a vertex cover. The last section finally summarizes 
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the results and gives an outlook to possible extensions. 

II. MODEL AND ALGORITHMS 
A. Vertex cover and related problems 

Let us start with the definition of vertex covers [JO : 

Take any graph G = (V, E) with N vertices i 6 {1, N} and M undirected edges {i,j} S E C V x V. A vertex 
cover (VC) is a subset U C V of vertices such that for every edge {z, j} <G £7 there is at least one of its endpoints i or 
j in U: 

UcVisVC ^ V{i,j}eE: ieUVjeU (1) 

We call the vertices in U covered (cow), whereas the vertices in its complement V \ U are called uncovered (uncov). 
The definition of a vertex cover implies therefore that every edge has at least one covered end-point. 

The full vertex set V is of course a trivial vertex cover of any graph G. In this case, all edges have two covered 
end-points, and at least some of the vertices can be set uncov without uncovering any edge. The corresponding 
optimization problem consists in finding a vertex cover of smallest cardinality. This problem belongs, according to 
the standard book by Garey and Johnson Q, to the basic NP-hard optimization problems. Therefore, it is expected 
to require a solution time growing exponentially in N and M. The numerical solvability is consequently restricted to 
relatively small graphs. 

VC is related to other well-known and widely used NP-hard problems. The first one is the independent set (IS) 
problem. An IS is a subset S C V of vertices such that for all i,j £ 5 we have {i, j} ^ E. So V \ S is obviously a VC 
for every IS S, and every maximal IS is the complement of a minimal VC. The independence number, defined as the 
maximal cardinality max(|5|) of all ISs, is consequently given by N — minyQ v \U\. 

A clique is a fully connected subgraph. So, if the vertex subset S C V is an IS in G = (V, E), it is a clique in the 
complementary graph G = (V, V x V \ E). Finding the largest clique in one graph is equivalent to finding the largest 
independent set in the complementary graph. 

There is also a physical problem which is equivalent to vertex cover, or more obviously to the independent set 
problem. Imagine the graph G to be a lattice, and pack hard spheres of chemical radius 1 onto the vertices. Then, 
once a vertex is occupied by such a particle, all neighbouring vertices have to be empty. This is exactly what defines 
an IS. The vertices which are not occupied by spheres thus form a VC. This equivalence provides the basis of the 
statistical mechanics' approach to minimal vertex covers on random graphs |p7| . 

B. Heuristic algorithms for constructing small vertex covers 

As already mentioned, the construction of a minimal vertex cover is NP-hard, thus requiring exponential time 
resources. It is therefore reasonable to develop good approximation algorithms running in polynomial time. Here we 
describe a class of linear time heuristic algorithms which are able to produce small, but in general suboptimal VCs. 

In this algorithm, vertices are sequentially assigned the values cov and uncov until the full graph is covered. An 
assigned value is not changed any more. This can be interpreted as a graph reduction process: Once a vertex is 
covered, it can be removed from the graph, together with all incident edges. If a vertex is set uncov, all its neighbours 
have to be covered in order to cover the graph. The central vertex, its neighbours and all covered edges can again 
be removed from the graph. The graph thus becomes smaller and smaller, until no edges are left. The size of the 
resulting vertex cover crucially depends on the order of the vertex selection and the decision to cover/uncover the 
selected vertex. The main heuristic idea is simple: A vertex of high degree is more likely to be covered, a vertex of 
small degree is more likely to be uncovered [It]]. The simplest local information, namely the vertex degree, is thus 
correlated to the structure of small vertex covers, and can be exploited algorithmically. 

This is done in the following way: Given an initially uncovered graph G = (V,E) and a non-negative integer k, 
which we call the depth of the algorithm. In every algorithmic step a vertex i is chosen randomly, and its nearest, 
2nd-ncarest... and fcth-nearest neighbours are selected. All these vertices, together with all edges connecting two of 
it, form the induced subgraph G^ k '(i) — (V^ k,> (i),E^(i)). This subgraph can be efficiently covered such that all fcth 
nearest neighbours are set to cov. For details see the algorithm presented below. The full subgraphs, together with 
all edges connecting it to other vertices, is deleted from G. 

For locally tree-like graphs, as e.g. random graphs or Bethe lattices, the vertex covers of G^ k '(i) are especially 
simple: The fcth neighbours of i are covered, the (k — l)st are uncovered, the (k — 2)nd are covered again, and so on, 
until i itself is covered (uncovered) for even (odd) depth k of the algorithm. 
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The main heuristic concerns now the question, how the central vertex i is selected. It exploits the above-mentioned 
correlation between vertex degree and covering state of an arbitrary vertex. For even depth k, the central vertex is 
covered by the above procedure . So it is useful to choose more frequently vertices of high degree in the subgraph 
remaining after elimination of already considered vertices. We therefore select a vertex of degree d with some weight 
Wd which is a monotonously growing function of d. 

In the case of odd k, the central vertex is uncovered ju^. Here, the selection weight Wd for vertices has to be a 
monotonously decreasing function of the vertex degree d. 

The algorithm is summarized as follows, inputs are the graph G = (V,E), the non- negative integer depth fc, a 
mapping m : {1, N} — > {free, cov, uncov}, which is constantly set to m{i) = free initially, and the positive weight 
function w : N — > M + : 

procedure heuristic- VC(G, k, m, w) 
begin 

if E = then 

stop; {all edges are covered by vertices with m(i) = cov} 

Select a vertex i £ V of current degree d(i) randomly with weight Wd(i)', 
if = 
begin 

m(i) := uncov; 
V:=V\{i}; 
heuristic- VC(G, k, m, w); 
end; 
else 

begin 

V<°>(i) :={»}; 
for k from 1 to 

:= V^ K ~ l '(i) U {«;th nearest neighbours of i}; 

(i) ;= { { J; j) & E\ie VW($) vie F (fe) (*) }; 

1/ 1= V\ yW(t); 

£ :=£\ J B( fe+1 )(z); 

m(j) := cew for all fcth neighbours of i; 
while V<> K -V(i) ^ 
begin 

Select a vertex j G V r( - K_1 - ) (i) of maximal distance from i; 
m(j) := uncov; 

m{l) := cov for all neighbours I £ V^ K_1 )(i) of j; 
: = VO" 1 )^) \ {j, neighbours of j}; 
end; {subgraph covered and removed from G} 

heuristic- VC(G, k, m, w); 
end; 

end; 

Please note that the degree of free vertices may change whenever G is reduced. The algorithm always considers 
the current degree in the reduced subgraph, which equals the number of uncovered incident edges. The algorithm 
therefore defines a Markov process. 

Some special cases of the algorithm where already considered for finite connectivity random graphs: In Jl8[ , the 
case k = and Wd = 1 was included into a complete backtracking algorithm. The upper bound for the minimal vertex 
covers constructed in this way was rather poor, but it will be improved in sections |y| and ^ by using better Wd- 
The case of k = 1, Wd = 1 was analyzed in j^] using a different technique. Whereas being also quite unsatisfactory 
for small and intermediate average graph connectivities cq — 2M/N, this algorithm correctly reproduces the leading 
asymptotic behaviour for large cq. In [fl6|| , very surprising results where obtained for k — 1, Wd — Sd,i, where only 
vertices of degree 1 (leafs) are selected and uncovered, their neighbour is covered, and both are removed from the 
graph. This algorithm is able to cover almost all edges for c < e, thus producing a minimal vertex cover, but it stops 
for higher connectivities if no vertices of degree 1 are left, even if an extensive number of edges remains uncovered. 
These two results suggest a promising generalization for the case k = 1: If we choose W\ ^> u>d > for all d > 1, 
this algorithm will work nearly as well as the leaf removal procedure for small connectivities, but it will also give the 
correct asymptotic behaviour for large Co- The extreme case of choosing always a vertex of smallest current degree 
will work best on random graphs, but it goes beyond the analysis presented in this paper. 
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C. Random graphs of arbitrary degree distribution 

In order to gain some insight into the typical behaviour of this algorithm, we apply it to random graphs. This 
subsection is dedicated to summarizing some interesting known results about these graphs, as far as they are important 
for our analysis. As can be expected from the algorithm presented above, we will concentrate our attention to the 
distribution of vertex degrees. For a complete presentation see po[ . 

The original idea [^l] is to assign an equal probability to all graphs having the same numbers N of vertices and M 
of edges. A random graph Gn, p , with < p < 1, is constructed in the following way: The vertex set is chosen to be 
V = {1, 2, N}. For all vertex pairs i,j € V, i < j, an edges is included into E with probability p. The two vertices 
remain disconnected by a direct edge with probability 1 — p. This graph has on average M = p(^) edges, its mean 
vertex degree equals Co = (N — l)p. 

The most interesting case for vertex covers are graphs of finite average connectivity, i.e. the average vertex degree 
Co = 2M/N stays finite in the thermodynamic limit N — > oo. In the above language, we have to fix p = j^tj- The 
resulting degree distribution is far from uniform. For N 3> 1, a randomly chosen vertex has degree d with probability 

Pd = e- C0 §, (2) 

i.e. the degree distribution approaches a Poissonian in the thermodynamic limit. In our analysis we also need the 
probability of finding a vertex of degree d by following an arbitrary edge. It is obviously proportional to d pd, due to 
normalization we have 

Pd ~ 6 (d - 1)1 ' [6) 

We thus find a Poissonian distribution of d — 1. The average degree of vertices reached by following an edge equals 
c + 1, so there are on average Co additional edges. 

Random graphs undergo a percolation transition at average vertex degree Co = 1. Below this threshold, the graph 
consists of an extensive number of small connected components, each containing up to O(lnTV) vertices. For Co > 1, 
the number of small connected components of Gat iC /(at_i) is still extensive, but there is also one macroscopic connected 
component of O(N) vertices. This giant component grows with increasing Co, and exponentially approaches size N 
when Co becomes large. 

The concept of random graphs was recently generalized to random graphs of arbitrary degree distribution p2| . p3| . 
There, every graph of a given distribution pd (not necessarily a Poissonian) is assigned the same probability. These 
graphs can be easily generated: For all vertices i = 1, ...,N, a degree d(i) is drawn randomly from pd- If J2i d(i) 
is even, we continue, if not, we repeat the above procedure. Then a large vertex set is created, containing every 
vertex i exactly d(i) times. Now we sequentially select pairs of vertices and add these to the edge set E, excluding 

only self-connections. Following again an edge, the reached vertex has degree d with probability p^ — d pd/co, with 
co = J2k k Pk denoting the average degree. 

D. Minimal vertex covers on random graphs 

Before analysing the behaviour of the presented heuristics, we will give a short overview over known properties of 
minimal vertex covers on random graphs, see []l7| for the original presentation. 

The analysis there was carried out for random graphs Gjv,c /(iv-i)! using the mapping to a hard-sphere lattice gas 
described in subsection II A. Using the replica method, a grand-canonical approach was taken, including a chemical 
potential /j, controlling the number of hard spheres. In the limit /x — > oo, the system tends to the closest packings, 
or, equivalently, to the minimal vertex covers. Assuming the validity of replica symmetry, it was found that minimal 
VCs contain a fraction of vertices given by 

= i IU(cq) 2 + 2^(c ) 
2c 

with W^(co) being the real branch of the Lambert-W function defined as the inverse of We w = cq. It was also shown, 
that replica symmetry is locally stable for co < e, whereas it is unstable for larger average connectivities, leading 
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to broken replica symmetry. The correctness of (Q) was recently shown to be exact in [[L6| based on a leaf-removal 
algorithm, which, as mentioned above, can be understood as a variant of heuristic- VC. 

An interesting insight into the structural properties of minimal vertex covers was given by identifying a covered and 
an uncovered backbone. The first one is defined as the set of all vertices which are covered in all minimal VCs, the 
uncovered backbone unifies all vertices being uncov in all minimal VCs. Denoting their relative sizes by b cov / uncov (co), 
the replica symmetric analysis leads to 

W(cq) 2 + W{c ) 

b C ov{co) =1 

co 

h ( \ W ( Co) (*\ 

Ouncov(Co) — ■ (O) 

CO 

The remaining NW(cq) /c vertices belong neither to the covered nor the uncovered backbone, they change the covering 
state from one minimal VC to the next. A strong correlation between degree distribution and backbone was observed: 
Vertices of small degree tend to be more frequently in the uncovered back bone , whereas vertices of high degree can 



be found more likely in the covered backbone. As mentioned in subsection [IB, this can be exploited in the heuristic 
algorithm by adapting the selection weights. 

III. RATE EQUATIONS FOR THE DEGREE DISTRIBUTION 

A. Graph reduction dynamics 

We assume that the input to the algorithm heuristic- VC is a random graph G ~ (V, E) with N vertices and degree 
distribution pd, and we concentrate o n the graph reduction process for a moment. The size of the constructed vertex 



cover will be calculated in subsection III B 



In every algorithmic step, a vertex is selected with weight Wd depending only on its current degree d. Then, this 
vertex and all its nearest neighbours, 2nd nearest neighbours,... kth nearest neighbours are removed from the graph. 
The edges incident to these vertices are removed, too. Following this procedure, a smaller graph is defined, and the 
algorithm is iterated. This graph reduction process is Markovian, because the action of each algorithmic steps depends 
only on the properties of the current reduced graph, more precisely on the current vertex degrees and neighbourhood 
relations. 

Let us further assume, that we start at (algorithmic) time t = 0, and every iteration step is counted as At. 
The dynamics will be described by rate equations for the vertex-degree distribution pd(t), or the number of vertices 
Nd(t) = pd{t)N(t) of degree d, where N(t) denotes the remaining vertex number at time t. Their dynamics can be 
decomposed into the following elementary processes (where (-)t = SdLoO^dfX) denotes the average over the current 
degree distribution Pd(t)): 

• Removal of the central vertex: A central vertex of degree d is selected with weight Wd, i.e. with probability 
WdPd(t)/ {wd)t- Nd(t) is thus reduced by one with this probability. 

• Removal of the 1st, 2nd,..., kth nearest neighbours: According to the last item, the central vertex has on average 
(wdPd(t))t/(wd)t neighbours. As the degrees of neighbouring sites are uncorrelated in random graphs, each of 
these has degree d with independent probabilities p^(i) = dpd(t)/(d) t - Random graphs are locally tree- like, 
d — 1 of the d edges of a 1st neighbour lead to 2nd nearest neighbours, i.e. the average number of 2nd neighbours 
equals (^J7^ ar g umen t can easily extended to 3rd neighbours etc. 

• Update of the connectivity of {k + l)st neighbours: The edges connecting fcth and (k + l)st neighbours are 
removed from the graph, too. The degree of every (k + l)st neighbour is thus reduced by one. 

These processes are combined to evolution equations for the expected numbers Nd(t) of vertices with degree d at time 
t: 

N d (t + At) = N d (t) - - «i ± ( ^r^r" 

(w d )t (w d )t ^ V Wt J Wt 

(dw d )t f(d(d-l)) t \ k (d + l) Pd+1 (t) - d Pd (t) , 



(wd)t V (d)t J (d) 
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The first line describes the deletion of vertices, the second the update of the degrees of all (k + l)st neighbours. 
These equations are valid for the average trajectory, which is, however, followed with probability approaching 1 for 
N = N(t = 0) — > oo. Macroscopic deviations appear only with exponentially small probability and are thus important 
for small N only. The quality of using the average trajectory is demonstrated in the inset of fig. |l|. There the trajectory 
of a single graph with N = 3 • 10 4 vertices is found to excellently follow the analytical prediction. 

Using equations (p|), we can calculate also the evolution of the total numbers of remaining vertices, N(t) = Nd(i), 
and edges, M(t) = JX^dW^t): 



N(t + At) 
M(t + At) 



N(t) - 1 



M(t) 



(dw d )t 



E 



f(d(d-l))t 



{w d )t ^ \ 



1 {dw d )t 

2 (w d )t 



(d)t 



(d)t 
fe+i 

E 



\{d(d-l))t 


m—1 


\{d(d-l)W 


k+l\ 


[ (d)t _ 




[ (d)t _ 





(7) 



As we are mainly interested in the behaviour of large graphs, N ^> 1, we may change to intensive quantities by 
writing N(t) = n(t)N, Nd(t) = pd(t)n(t)N . Setting further At — and replacing differences by derivatives in the 
thermodynamic limit, we find 



h(t) = -1 - 



(dw d ) t A ( (d(d-l)) t 
^ [ (d)t 



{wd)t ~ V 

* ' m— 1 v 



ii{t)pd{t) + n(t)p d (t) 



WdPdjt) _ (dw d )t 
(w d )t (w d )t 



E 



(d(d-l))t 
(d)t 



dpdjt) 
(d)t 



{dw d ) t f(d(d~l)) t \ k {d+l)p d+l {t)-dp d {t) 



(d)t 



(d)t 



(8) 



The graph reduction process is thus described by an infinite set of non- linear differential equations, where the non- 
linearity enters only through the time-dependent averages (-)t. As we were starting with an ordinary random graph, 
these equations have to be solved under the initial condition 



n(0) 
Pd(0) 



1 



-c 

d\ 



where cq equals the initial average vertex degree. 

In section ^ we also need the dynamical equations for the moments {d n 
(|J) with d n and summing over all degrees yields 



(9) 



oipd(t). Multiplying the second of eqs. 



m d./^v _ Mt(d n )t ~ (d n w d ) t , (dwd^jdW^-jd^t A f (d(d-l)) t 
n[t) dt {d)t - (w d ) t + (w d ) t (d) t (d) t 

, {dw d )t (d{d - l) n ) t - (d n+1 ) t ( (d(d - l)) f 



(w d )t 



(d)t 



V (d)t 



(10) 



Please note that these equations do not contain any finite and closed subset of equations, because the evolution of 
any moment depends also on higher moments. 

A similar approach was chosen in Q to analyze an algorithm constructing the maximal sub-graph having mini- 
mal degree K, i.e. the so-called K-core. Pittel et al. rigorously derived and solved a closed set of equations for 
An(i), NK-i(t) and M(t). An analogous reduction to a finite number of equations will be constructed in section 
[V| for the generalized leaf-removal algorithm, but it cannot be achieved for the general case. 

Our approach resembles also the rate equation approach used in the area of growing networks |2^, ^6). Note, 
however, that there the evolution of the number Nd(t) of vertices of degree d depends only on the vertices having 
smaller degree, because edges are always added and never deleted. So, in principle, the evolution equations can be 
solved by calculating first No(t), then Ni(t) and so on. In the graph reduction process the problem becomes more 
complicated since the evolution of Nd depends also on A^ +1 , for arbitrary d, but there is no maximal degree d in the 
Poissonian initial condition. 
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B. The cardinality of constructed vertex covers 

Before trying to solve equations (|^,^) for specific choices of Wd and k, we will give general expressions for the number 
X(t) of vertices which are covered by the algorithm. 

For the locally tree-like case of random graphs, the fcth neighbours of the selected vertex are covered, the (k — l)st 
are uncovered etc. So the covering state of the central vertex depends on the depth k: For even k, it will be covered 
(if d ^ 0), for odd k, it will be uncovered. We therefore consider these two cases independently. 



1. Odd depth k 

For odd k, the central vertex is almost always uncovered. Denoting the expected number of covered vertices at 
time t with X(t) = x(t)N, we thus find 

X(t + At) =X(t ) + ^l ( Xf f^^i) 2m , (ID 

^ V (d)t J 

cf. the first of equations (^). Going again to the limit of large graphs, N — > oo, this can be written as a differential 
equation for x(t): 

± (i ) = ^ (fc g /2 (M^) 2m . (12) 

Once we know the solution of the graph dynamical equation (^), we can calculate the time tf where all edges are 
covered, (d) tf — 0, and integrate the last equation over the time interval [0,i/]. As all removed edges were covered 
by our algorithm, we thus have constructed a vertex cover of relative size x(tf). As the described average trajectory 
is followed with probability one for N — > oo, this x(tf) gives an upper bound for the true minimal vertex cover size 
of the random graph under consideration. 



2. Even depth k 



For even k, the central vertex is covered in general. Only if it is disconnected, i.e. if its degree equals zero, it is set 
to uncov, see the algorithm heuristic- VC. The last case happens with probability "ff ■ We thus conclude for X(t) 

X(t + At) = X(t) + 1 - ^ i ^ n ^) M , d3) 

(w d ) t (w d } t ^ Q V ( d )t > 



or, in the limit N — ► oo, 



= +1 _ W0P0Q + {dw^t "'y ( (d(d - 1))A 2m+1 

This equation can be integrated, once we know the solution of equations (||), and an upper bound to x c {cq) can be 
read off. 



IV. THE SOLVABLE CASE OF LINEAR SELECTION WEIGHTS w d 

The problem in solving differential equations (^|) with initial conditions (^) is, that the Poissonian shape of the 
degree distribution is, in general, not conserved under the dynamics. In such cases one has to keep track of all the 
individual probabilities Pdit) for each possible degree d. As the dynamics of Pd(t) depends on pd+i(t) for all d, and 
d is not bound from above for the Poissonian initial condition, it is not obvious how to construct a finite and closed 
subset of equations which can be solved separately, opening the door to the solution for all p d - 
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There exist, however, some cases where the Poissonian shape of the degree distribution is conserved, as can be 
shown explicitly by plugging a Poissonian Ansatz 

p *® =e ~ c{i)Cj w (15) 

into (|^) and verifying, that the same equation for the average vertex degree c(t) is reproduced for arbitrary d. The 
most general case for this behaviour is found for linear selection weights 

w d = A-d + B (16) 



where A, B are arbitrary non-negative real numbers. In this case, the graph can be totally specified by calculating 
n(t) = and c( 
expressed via c(t) : 



n (t) = an d c (t) — 2 jy(t) • Their evolution can be read off from equations (^), where the averages (-)t can be 



(d)t = c(t) 

(d(d-l)) t = c(tf 

(w d ) t = Ac(t)+B 

{dw d ) t = Ac{t) 2 + (A + B)c(t) (17) 

In the limit N — ► oo the graph reduction dynamics is thus completely determined by the differential equations 

v ' Ac(t) + B ^—^ 

/ n / n / , / n Ac(t) 2 + (A + B)c(t) -J^ , .„, , , 

n(t)c(t) + n(t)c(t) = -2 W 1 >K> £ c(t) m (18) 

^ ' m=0 

Eliminating nit) from the second equation, we end up with 



Ac{t) 2 + (2A + B)c(t) _ Acjt) 2 + (A + B)c{t) 
Ac(t) + B Ac(t) + B 

These equations have to be solved under the initial conditions n(t = 0) = 1 and c(t = 0) = cq 



w w Acit) + B Acit) + B ^-^ v ' 



A. Constant selection weights: A = 0, B = 1 

Equations ( |l8| , ^9|) simplify further if we restrict it for a while to constant selection weights Wd = l, i.e. A = 0, £> = 
1. There we find 

k 

n(t) = - <t) m 

m=0 

n(*)c(i) = c(t)A(i) . (20) 

In the second line, the equation for n(t) was already used to eliminate the complicated sum of powers of c(t). Using 
the initial conditions n(t — 0) = 1 and c(t = 0) = Co, the second line results in 

c(t) = c n{t) , (21) 

and one of the two functions can be eliminated from the first of equations (|o|) . We consequently find 

k 

m = - Co J2 c (*r ( 22 ) 

m=0 

which is solved implicitly by 
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The algorithm stops when all edges are covered, i.e. for c(tf) = 0. This final time tf corresponds, in the original 
algorithmic language, to tfN iterations of heuristic- VC, and is given by 

1 r C0 dc 



These results can be used in order to determine the relative size xt(co) = x(tf) using the results of section IIIB. 
There we observed a difference between even and odd values k of the depth of heuristic- VC according to the fact that 
the central vertex in one case is almost always covered, in the other case uncovered. We therefore continue discussing 
these cases separately, starting with k — 0, going then to arbitrary odd k, and discussing general even k at the end of 
this section. 



1. The simplest algorithm 

The simplest possible algorithm has depth k = 0: In every algorithmic step an arbitrary vertex is chosen and 
covered if its degree is non-zero, uncovered else. The vertex and all incident edges are removed from the graph. This 
simple algorithm was already analysed in Jl8| as the heuristic underlying a complete backtracking algorithm. The 
results given there can be easily reproduced, for k = the integration in eq. ( p3| ) can be trivially carried out. We 
find a simple linear decrease of the average vertex degree, 

c(t) - (1 - f)co , (25) 

and the final time becomes tf = 1 as one vertex is removed in every algorithmic step. The resulting size of the 
constructed vertex cover follows easily by integrating equation (§~4|), with po(t) = e~ c (*': 

x) '(co) = 1 , 26 

cf. |T§| ]. This gives the very first and simplest upper bound on the true size of minimal vertex covers which is, however, 
not very good: For, e.g., c = 2, we find Xf(2) — 0.5677 compared to the true value x c (c) — 0.3919, cf. eq. (||). Also 
the asymptotic behaviour for large average vertex degrees, Xf(co >> 1) ~ 1 — ^, does not meet the exact asymptotic 

behaviour, which was evaluated by Frieze [^7| to be x c (cq >> 1) ~ 1 — to leading order. 



2. Gazmuri's algorithm and odd depths 

This asymptotics is found to hold also for a slightly more complicated case: It is valid for all non-zero values of the 
depth, i.e. for k > 0. Let us, for simplicity, start with arbitrary odd values of the depth k of the algorithm. For k = 1, 
the algorithm is equivalent to the one proposed by Gazmuri jq]: In every time step, an arbitrary vertex is chosen and 
set to uncov, all its neighbours are covered, and the whole cluster including all incident edges are removed from the 
graph. Gazmuri has already characterized the performance of this algorithm, using a different technique. 

Please remember that, according to equation (^2|), the time dependency of the mean vertex degree is given by 

k 

c(t) = - CQ J2 C W™ ■ (27) 

This can be used to solve equation (jl^) for the evolution of the number of covered vertices, which, using the Poissonian 
distribution (|l^), and integrating over t reads 

r t (fc-i)/2 

x{t) = dt' c (0 2m+1 ■ (28) 

•'0 m=0 

Changing variables from t to c, and plugging in equation (|27j), we find 

x(c) = - / dc ^ k 



dc- 



c J c 1 + c 

(29) 

co co 1 + c 



10 



This expression gives the x-c-trajectory which is interestingly independent on the depth fc (as long as k is odd). The 
only difference is given by the time dependencies x(t) — x(c(t)) as c(t) is fc-dependent, cf. equation (|23|). 

The graph is completely covered when c(t) reaches zero. The cardinality of this vertex cover is almost surely given 
by x f( c o) = x(c = 0), i.e. 

4M) (co) = 1 _Ml±fo) (30) 

1 CO 

independently on the (odd) depth k of the algorithm. For k = 1, Gazmuri's bound is thus reproduced, and the leading 
order of the behaviour for large initial connectivities Co is correctly found. The algorithm is, however, less successful 
for small and intermediate connectivities, as we will see in the following sections. 



3. The case of even depth k > 2 



The case of even depth leads to more complicated expressions, which cannot be evaluated explicitly. The main 
problem is induced by the po (^-contribution in the evolution of x(t), as given in equation (fl4"|). After having applied 
the Poissonian ansatz (|l^), the latter reads 



/ WE ^ 

Ja \m=0 



x(t) = / dt' \ V c{t'f m - e~ c « I , (31) 



hence we find for the relative vertex-cover size, and arbitrary even depth k 

4 M) (co) = ^-/ d ^» C k 6 . (32) 
c ° J o E„=o c 

This integral cannot be evaluated explicitly for arbitrary even k. We can, however, extract the asymptotic behaviour 
for Co ^> 1. In this limit, the terms of 0(e~ c ) and 0(c°) can be neglected in both the numerator and the denominator 
in the last integral. The corrections from the integration interval (0,0((co) )) are of order 1 and thus suppressed by 
the prefactor 7-, compared to the leading terms 

(fc,o), ln(l + c ) 

x\ ; (co>l)~l (33) 

1 c 

which coincide with the case of odd depth. 



B. Linear selection weights: A — 1, 5 = 

After having discussed in great detail algorithms with Wd = const., i.e. simple algorithms selecting central vertices 
completely at random, without regarding its degree, we now turn to the case of linear Wd- In this case, as already 
mentioned at the beginning of this section, the degree distribution still stays Poissonian. This can be understood 
intuitively in the following way: The case Wd = d is equivale nt to choosing an arbitrary edge with constant probability, 
and selecting one of the end-vertices. According to section |ll C| the chosen vertex will have degree d with probability 

°f dpd- The more general case Wd = Ad + B, cf. eq. (fl6|), corresponds to mixing this selection procedure (weight 
A) with the uniform selection of vertices (weight B). 

Fixing A to a non-zero value is sensible only for even depth values fc since these correspond to covering the central 
vertex of the cluster of radius fc. As mentioned above, the vertex degree is correlated to the covering state in small 
vertex covers, so it does not make sense to preferentially select vertices of high degree and to uncover it subsequently. 
The performance of the algorithm is thus only improved for even fc. The strongest improvement is obtained for Wd = d, 
i.e. for B = 0. 

Whereas eqs. ( p^ , p^ ) lead to complicated coupled non-linear differential equations for c(t) and n(t), which have to 
be solved numerically for general even fc, the case fc = becomes very simple. There, the equations read 



h(t) = -1 
n(t)c(t) = -c(i) - 2 
x(t) = 1 



(34) 
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and are solved by 

n(t) = 1-t 

c(t) = c -(2 + c )t 

x(i) = t (35) 
The graph is covered for c(tf) = 0, which leads to vertex covers of size 

xf 1 \c a ) = l--^ . (36) 

This size is always smaller than the one found for the very simplest algorithm (wd = 1, k = 0), but stays worse than 
Gazmuri's algorithm (wd = 1, k = 1). Also the asymptotic behaviour is not correctly reproduced. 



V. AN APPROXIMATION FOR DEPTH-ZERO ALGORITHMS WITH NON-LINEAR SELECTION 

WEIGHTS 

If we choose non- linear selection weights Wd = d a , a ^ 0,1, the graph reduction dynamics deviates from the 
unrestricted ensemble of random graphs, and the degree distribution becomes non-Poissonian. The new distribution 
thus cannot be described by the evolution of its mean value alone, and we have to solve all equations from (||) 
simultaneously. In general, this cannot be achieved analytically. To approximate the solution numerically, we may 
cut the tail of Pd(t), and solve only a finite number of equations. This works fine for small initial values of cq — c(t = 0) 
because of the rapid decrease of the Poissonian distribution. For larger values of Cq however, the number of remaining 
equations becomes large, too. So it would be better to find an approximation of Pd{t) depending only on a small 
number of parameters. The dynamics of these parameters can be determined from the lowest moments (d m )t, with 
m ranging from 1 to the number of parameters. 

This section is dedicated to algorithms of depth k = 0, but non-linear selection weights Wd = d a , a / 0,1. Every 
algorithmic step thus removes one vertex from the graph. No vertices of degree are selected (wo — 0); all selected 
vertices thus have to be covered according to heuristic- VC. We thus trivially have 

n(t) = 1-t 

x{t) = t (37) 

and the size of the constructed vertex cover is given by x^' a \co) = tj with c(tf) — 0. Note that this does not 
necessarily imply n(tf) — as only vertices of non- vanishing degree are selected. At time tf, the remaining graph 
consists of (1 —tf)N completely disconnected vertices. 

As the initial condition pd(t = 0) of the graph reduction dynamics is given by a Poissonian of mean Co, we are 
looking for a deformation of the Poissonian distribution which allows to independently vary mean and variance, and 
thus to approximate the true Pd(t). A simple possibility is given by the generalized binomial expression 

For /j,(t) — > 0, this expression approaches a Poissonian distribution of mean c(t), the initial condition is thus charac- 
terized by c(t = 0) = Co and fj,(t = 0) = 0. Please note, however, that ( |3^ ) does not necessarily describe a probability 
distribution, because itd(t) becomes negative for certain d if l/p,(t) is not a positive integer. We do not expect this 
to produce serious problems for the calculated averages, as long as the absolute value of these negative TTd(t) stays 
neglectable compared to the total normalization 1. This is exactly what happens in our case, as we will see below. 
The moments of nd(t) are given by 

oo 

n("+ 1 )(t) :=^rd(d-l)---(d-n)n d (t) = c{t) n+1 [l [1 - 2 t i{t)] ••• [1 - n^{t)\ . (39) 

d=0 

The product d(d — 1) • • • (d — n) can be expanded into a sum of pure powers, their mean values are determined by 
inverting this sum: 

oo n 

fiW (t) := £ d n n d (t) = J2 «L n) n (n) (t) . (40) 

d=0 m=l 
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The coefficients are given iteratively by am = mam ^ + o,m—i ' using the trivial identity dm = S m .i and the 
convention = for all n. 

Given two non-trivial moments, e.g. n = 1, 2, c(t) and /i(t) can be calculated, and all other moments are determined. 
We can thus approximate the dynamics of the degree distribution by considering of the dynamics of the first two 
moments of Pd{t) only. The exact equations for (d) t and (d(d— l))t follow from eq. ( p^| ) by fixing k = and Wd = d a , 

(l-t)i(d) t = (d) t - 2- (fi ' 



dV 11 sn (d a ) 



(1 - t) ' w - 1)), . w - 1)), _ (£2. + O (i - ■ («) 



They contain higher moments of Pd(t), but are closed approximately by using ( |39| , [40| ): 

(l-t)—c(t) = c(t)-2 — = ^ 

v ; <ft w w n(«)(t) 

J fT(a+2)Cy.\ fr(a+l) M 

(1 - f)- (c(i) 2 [l - M (t)]) = c(t) 2 [l - M (t)] - flw y + y (1 - 2c(i)[l - /.(*)]) (42) 

These two equations can be easily converted to ordinary differential equations c(t) — F c (c(t) , n(t) , t) and fi(t) — 
Ffj,(c(i), n(t),t) which are, however, not analytically solvable for general values of a. They can instead be solved 
efficiently using numerical standard techniques. The results are displayed in fig. |l| together with numerical simula- 
tions obtain for large graphs. We find that the binomial approximation works extremely well for small values of a, 
systematically growing deviations appear for larger a, cf. fig. [| We also find that heuristic- VC is able to approximate 
the true minimal vertex-cover size up to a few percent, performing better for larger a. We observe, however, that 
even the vertex covers constructed for very large a remain suboptimal, i.e. extensively larger than the minimal VCs. 

The behaviour of eqs. (M2) for large c[t = 0) = cq can be extracted analytically by expanding the equations for 
c(t) (p(t)) to 0(1/ c) (Otl/c 2 )). F^ is a sum of terms of 0{fi 2 ), 0(p/c) and 0(l/c 2 ), and (x(t) stays of 0(l/c 2 ) due 
to its initial condition /j,(0) — 0. We thus find (1 — t)c = — c — 2a — 0(1/ c) which is solved to leading orders by 
c(t) ~ Co — t(co + 2a). From the vanishing of these leading orders we can read of the dominant contributions to the 
constructed vertex covers, which we conjecture to be exact also for the true dynamics: 

«y.«)(*>i)~i__H5L_. ( 43) 

1 co + 2a 

For larger a, the asymptotics becomes better and better, but still does not reach the correct behaviour x c ~ 1 — 
ln(co)/co of the minimal VCs. Note that, for sufficiently large Cq, Gazmuri's depth-one algorithm outperforms the 
depth-zero algorithm for arbitrary a. We expect, however, that the correct asymptotic behaviour is reached by 
exponential selection weights Wd, and hence in particular for the heuristic where always a vertex of maximal degree 
is chosen. 



VI. GENERALIZING THE LEAF REMOVAL PROCEDURE: DEPTH-ONE ALGORITHMS 

The best performance can be achieved using a generalization of the leaf-removal algorithm (LR) proposed by Bauer 
and Golinelli p5| . Their algorithm is based on the following observation: Consider a vertex of degree one, i.e. a vertex 
which has a single neighbour. One of these two vertices has to be covered in order to cover also the connecting edge. 
It is obviously better to cover the neighbour than the vertex of degree one. Iterating this procedure, there are two 
possible final situations: 

(i) All edges are covered, and the constructed vertex cover is a minimal one. 

(ii) There are uncovered edges, but no vertices of current degree one are left. The algorithm stops without having 
constructed a vertex cover. 

This algorithm can be understood as a special case of heuristic- VC with depth k = 1 and Wd = 641. Following a 
completely different route, Bauer and Golinelli have found a surprising result: For random graphs of average degree 
Co < e, their algorithm is able to cover almost all edges, and the predicted minimal vertex cover size coincides with 
the replica symmetric one found in |l3| . For larger average degrees, Co > e, case (ii) is valid, and a finite fraction of 
edges remains uncovered. We re-derive this result below using our dynamical rate equations. 

In order to construct a small vertex cover also for higher-connectivity graphs, the algorithm has to be modified to 



Wd > for all d > 0. The case Wd — A5di + 1, with A > 0, will therefore be analysed in sec. VI B. For A ^> 1, 
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this algorithm performs nearly as well as pure leaf-removal for small average vertex degrees. For large cq it finally 
becomes more and more similar to Gazmuri's algorithm, being still better for any finite Cq. We will call this algorithm 
generalized leaf removal (GLR). 

The best performance is, of course, obtained for Wd = e~ ad , with a — > oo. There always a vertex of minimal 
degree is selected and uncovered, all neighbours are covered. As long as the fraction Pi(t) of vertices of degree one is 
non-zero, the algorithm is equivalent to the leaf-removal procedure. This is valid in particular also for Co < e, where 
(almost) minimal VCs are constructed. The analysis of this algorithm goes, however, beyond the analysis presented 
here. 



A. Leaf removal 



Let us first concentrate on the leaf-removal algorithm (LR) in its original version, i.e. on depth k — 1 and selection 
weights Wd = Sd t i- In every algorithmic step, exactly two vertices are removed from the graph G, and exactly one 
vertex is covered. We therefore conclude 

n(t) = 1 - 2t 

x{t) = t (44) 
The degree distribution follows, according to (0), from the dynamical equations 

(1 - 2t)p d (t) = 2 Pd (t) - S dA - { -^d Pd (t) + {d{d ~ 2 1])t (d + 1 WW • (45) 

Wt Wt 

Vertices of degree d > 1 are only touched if they are first or second neighbours of a vertex of degree one, in which 
cases they are either covered and removed, or their vertex degree is reduced by one. The degrees of neighbouring 
vertices are statistically independent, we thus expect Pd(t) to keep its Poissonian shape for all d > 1. In fact, the 
ansatz 

Pd{t)=l{t)e-^^f- Vd>l (46) 

together with the global normalization 

1 = Po(t) +Pi(t) + 7 (t) (l ~ e-"W[l - «(t)]) (47) 

can be plugged into eqs. ( (45| ) and leads to uniquely determined equations for 7(t), n(t) and pi(t). The latter is, for 
technical reasons, replaced by an equation for c(t). Using 



(d)t = c(t) 



= Pi(t)+7(*)*(*) 

(d(d-l)) t = 7 (*)«(*) a , (48) 

these read 

Mt)n(t) 2 + c(t) 



(1 - 2t)c(t) = 2c(t) - 2 
(1 - 2t)k(t) = -K(t) 



c(t) 

~f(t) K (t) 2 + c(t) 
c(t) 



(l-2t)j(t) = T (*) 2C( * ) "® ■ (49) 
c(t) 

The initial conditions are c(0) = k(0) = cq, 7(0) = 1. The equation for the average vertex degree c(t) can be removed 
by observing 

(1 2t) dt { W ) = (1 2t) VW) ~W)) = ~ 2 W (50) 
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which is solved by 



c(t) 



(1 - 2t)c ' 

The solution of the two remaining equations is given implicitly by 

t = l-^-([ K (t)-W(c e K ^)] 2 + 2W(c e K ^)) 
W(c e K W) 



(51) 



(1 - 2t)c 



(52) 



W denotes again the Lambert-W function, cf. sec 



II D 



The graph is 
me 

(53) 



lit) = 

as can be checked explicitly using eqs. 

covered if this trajectory reaches c{tf) = 0, i.e. for = 0. From the first of eqs. ( |52| ) we thus find the final time 

+ 1 W(co) 2 + 2W(c ) 

r f = t . 

' 2c 

This result is only valid, if Pd(t) > for all d and all < t < tf. Using eq. (ft8|), we find 

"*(«(*)) • 



pi(t) = c(t) - 7(*)«(t) 

"(*) 
(1 - 2t)c 

«(*) 



(l-2i)c 

The prefactor of <E>(re) is non-negative, it is thus sufficient to investigate $(/c) for k > 0. We have $(0) = 0, and 

W(c e K ) 



~~ 1 + W(c e K ) 



1 - e 



— Kl ^ — K 



e- K iy(c e K ) , 



(54) 



(55) 



i.e. $'(0) = 1 — W^(co). The monotonous function W(co) becomes larger than 1 for Co > e, i.e. in this case pi(t) 
would approach zero from negative values. This is a contradiction. We therefore conclude 



Vc < e : a; Li? (c ) = 1 

2c 



(56) 



and this value coincides with the relative size of a minimal vertex cover. For cq > e the algorithm gets stuck if 
Pi(t) = is reached, no vertices of degree one are left, and a finite fraction of all edges remains uncovered. 



B. Generalized leaf removal 



In order to overcome this problem, we generalize the leaf-removal algorithm by modifying the selection weights to 
Wd — 1 + A5d t \ , This algorithm interpolates between the algorithms of Bauer and Golinelli (A — > oo, exact minimal 
VCs for Co < e) and the one of Gazmuri (A = 0, correct leading asymptotic behaviour for cq 3> 1). We thus expect 
that this algorithm shows a very good performance in the whole finite-connectivity region for large, but finite A. 

Also in this case, the Poissonian shape of Pd(t) remains correct for all degrees d > 1, and ansatz (Eq) together with 



the normalization constraint (47) remains valid. Plugging everything into the dynamical equations (|8|), we directly 
arrive at 



h(t) 



1 + c(t) + 2A Pl (t) 
l + A Pl (t) 



n(t)c(t) - c(t) 1 + C{t) + 2Api{t) 2 [7(t)K(t)2 + c( ^ [cW + Api{t)] 



(t)k(t) = -«(*) 



l + A Pl (t) ' [1 + A Pl (t)]c(t) 

[ 7 (t)«(t) 2 +c(t)][c(t)+MW] 
[l + A Pi (t)]c(ty 



r.\ ■ f.\ M c(t)+2Ap 1 (t) M c(t)+A Pl (t) 
n{th{t) ^ 7W l + A Pl (t) - K{th{t) l + A Pl (t) (57) 
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with pi(t) = c(t) — j(t)K,(t)[l — e^ K ^]. These equations determine the exact graph reduction dynamics for generalized 
leaf removal, and can be solved numerically. Due to the non-zero selection weights for all degrees, these equations 
do not suffer from the appearance of negative values for certain pd(t), and the algorithm always constructs a vertex 
cover. The number of covered vertices at algorithmic time t can be calculated from eq. ([l2|), which for our special 
choices of k and Wd reads 

c(t) + A Pl (t) 

X{t) = l + A Pl (t) (58) 

The relative size of the finally constructed vertex cover is, with probability one, given by x(tf), with tf following from 
c(tf) = 0. In figure |3], the results are presented for several values of A and compared with Gazmuri's resp. Bauer and 
Golinelli's algorithms. 



VII. SUMMARY AND OUTLOOK 



The solution of many combinatorial optimization problems requires exponential time resources and is thus restricted 
to relatively small system sizes. For larger systems, good and fast approximation algorithms are needed, which are 
frequently based on heuristic considerations concerning correlations between local problem structure and optimal 
problem solutions. 

Constructing a minimal vertex cover of a given graph belongs to the basic NP-hard problems, and can be un- 
derstood as a prototype combinatorial optimization problem. In this paper, we have therefore analysed linear-time 
algorithms for constructing small vertex covers of finite-connectivity random graphs. The applied heuristic exploits 
the observation that vertices of high vertex degree are more likely to be covered in minimal VCs, whereas those of 
small degree remain more frequently uncovered. 

We have introduced and analysed mainly two types of algorithms, namely depth-zero and depth-one algorithms. In 
the first case, vertices are selected randomly and (if connected to any other vertex) they are covered. We found that 
the performance of the algorithm can be largely improved by preferentially selecting vertices of high degree. 

We also observed that depth-zero algorithms were outperformed by depth-one algorithms. These select a vertex in 
every algorithmic step and uncover it. All neighbours of the selected vertex must be covered consequently. The best 
performance is achieved if the algorithm always selects a vertex of smallest degree. As was already found by Bauer 
and Golinelli |16[ ], this procedure even outputs an (almost) minimal VC if it is applied to random graphs of average 
connectivity Co < e. The algorithm constructs good approximations also for higher connectivities. 

Both types of algorithms can be interpreted as Markovian graph reduction processes. They are analytically char- 
acterized by the evolution of the degree distribution of the remaining uncovered subgraphs. The dynamical equations 
were solved in some cases, in other cases approximations were necessary. 

The presented approach can be extended into several directions: 

• The applied heuristic was restricted to considering the simplest local structure, namely the degree of the selected 
vertex. Depth-one algorithms can be improved by e.g. selecting a vertex of minimal degree but with maximal 
number of next-nearest neighbours. Covering the nearest neighbours thus results in a higher number of covered 
edges. It would be interesting to extend the rate equations to this case. 

• VC is used as a prototype optimization problem, but the approach can be generalized to other combinatorial 
problems defined over random structures, e.g. to graph coloring or satisfiability problems. For random 3- 
satisfiability, lower bounds for the SAT/UNSAT threshold are usually obtained using algorithms in the so-called 
card-game representation ^, which corresponds to Wd — const in our analysis. 

• Our analysis was restricted to the typical time evolution of the degree distribution. Deviations appear with 
exponentially small probability - and are thus important for small systems. These rare events can be systemat- 
ically exploited by exponentially frequent restarts of the algorithm. If a minimal VC is found with probability 
p = e~ rN , we need e^ T+e ' N restarts to almost surely construct a VC (for all e > 0). As observed recently for 
simple heuristics of vertex cover |^8| and 3-satisfiability , this random restart algorithm can be exponentially 
faster than exact standard procedures (like backtracking). The performance can be improved further by using 
a more sophisticated heuristics. 

• Also sophisticated complete algorithms, i.e. those that find an optimal solution for sure, use heuristic arguments 
for accelerating the combinatorial search. The presented ideas may hence contribute to the analysis of such 
algorithms, and the insight may be used to exponentially speed up the numerical search. 
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FIG. 1: Final size Xj, (c) of the vertex covers constructed by the depth-zero heuristic with a = 0, 1, 2, 6 (full lines from top 
to bottom). For a comparison, the replica symmetric x c {c) (dashed line, exact for c < e) and the results x^'°\c) of Gazmuri's 
depth-one algorithm (dotted line) are added. The inset shows the time dependent average vertex degree c(t) for the same values 
of a (full lines from top to bottom) together with numerical data for a single random graph with N = 3 • 10 . This illustrates 
the quality of taking the average trajectory (a — 0, 1), as well as the quality of the binomial approximation (a = 2, 6). 
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FIG. 2: (a) Degree distribution Pd{t) for heuristic- VC with depth k = 0, selection weights Wd = d 2 , and initial condition 
co = 10, for t = 0.2, 0.4, 0.6 (full, dotted, dashed lines). The symbols are numerical data for a single graph of size N = 3 • 10 4 
and coincide extremely well with the binomial approximation represented by the lines (lines are connecting data for integer d 
and thus are guides to the eyes only). The quality of the approximation is similarly good for all investigated initial c . 
(b) Same as (a), but with w d — d 6 . The coincidence between numerical data and binomial approximation is slightly worse 
than in (a), but still very convincing. The quality of the approximation increases with growing initial Co, supporting thus our 
conjecture that the asymptotic behaviour is correctly described by the approximation. 
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FIG. 3: Final size z/(c) of the vertex covers constructed by generalized leaf removal. The selection weight is Wd = ASd,i + 1 
with A — 0, 1, 10, 100 (dashed lines from top to bottom). For a comparison, the result of the original leaf-removal algorithm is 
represented by the full line: For c < e, a minimal VC is found, whereas the algorithm fails completely to construct a VC for 
c > e. 



